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Substrings derived from four-letter strings (eg. ABCD) wet? presented to subjects using a 
variation, on Bmrisfoid arid Franks' (19fl|) paradigm, £ach string was in either Upper or lower 
ate, Subjects were then tested for recognition of the strings, flbe recognition of translations of 
the strings into the other case, and false recognitions of new but legal string*. Subject* accepted 
previously seen strings most frequently, followed by translations, with New strings accrued least 
often. This replicates Rosenberg and Simon's (in press) findings with sentences and pictures that 
express the same concept. However, in the present experiment the twp forms of a siring wptb 
unbiased with respect to a verbal nr pictorial encoding. The forms In which a string could appear 
(upper or lower Case) were tint con Founded With the two type* of encoding (verbal and pictorial) 
hypothesized by a dual coding theory. The results supported (he view that the previously reported 
difference between the original form and a translation » best explained by a model which uses a 
ilfigle representation that preserves some form distinction* 


This report descries research done at the Artificial Intelligence Laboratory of the 
Massachusetts Institute of Technology. It was supported In part by the National Science 
Foundattm under grant C4M06X. 

The views and conclusions contained in this document are those of the author and 
should not be interpreted as necessarily representing the officiil policies, either expressed or 
implied, of the sponsors or the United States Government. 
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DUAL CODING AND THE REPRESENTATION OF LETTER STRINGS 


An intcresting issue in recent years has been the problem of whether people have more than 
one underlying representational system, The dual coding hypothesis {Pamo. 39?]) suggests that 
there are two systems for encoding- concrete verbal concepts; ohe propositionally based, and the 
other dependent on visual Imagery. This -question alio arises in other areas. For instance, do- 
people who speak more than one language fluently represent a concept expressed in one language 
in the same form as when it Is expressed In another? At least some researchers {Lambert & 
Rawlings, 1S69) have suggested that it is possible that bilinguals may have different 
representational syitemi for each language, depending on the circumstances under which the 
languages have been learned. 

Rosenberg and Simon {in press) Investigated this problem by making use of a paradigm 
developed by Brantford and Franks {1971K Biansford and Franks used sentences containing four 
propositions. They presented subjects, in an acquisition phase, with derived sentences containing 
One, two r or three of those propositions. They discovered that subjects, in a later recognition test, 
would also accept derived sentences which they had not previously seen. However, although 
subjects often thought they had seen these new sentences, [hey did not accept as many of tbessE as 
of the actually presented sentences (Franks * Biansford, 397i>. 

Rosenberg atid Simon developed a set of pictures which corresponded an content to the set of 
derived sentences. They then presented some of the items as pictures, and others in sentence form. 
They hoped to determine the form of representation by testing for false recognitions to items 
translated into the form opposite from (heir initial presentation., and comparing performance on 
this task with correct recognitions of previous^ ihcwm items, 

Rottnberg atid Simon's result! showed that subjects were Indeed con Fused and often accepted 
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translated Items as old, although not as frequently as taj presented in the original form. A 
second experiment wjth bilingual jubjert, gave the same result with translations from, one 
language to the other, 

Rosenberg and Simon explained these results in term? of a mridet which used a single system 
for representing relations, integrating Items which occurred in different forms into a single 
representation. However, modality information associated With occurences of lexical and Visual 
tokens was preserved. The model thus postulated some difference in knowledge content given a 
different mode of expression for an item, while preserving a single underlying system in which to 
represent that Information, The model, when implemented as a computer simulation reproduced 
Rosenberg and Simon's experimental results, Acceptance of translations was explained by the fact 
that In ft single storage model, many tokens in the internal representation had associated attributes 
from both forms in which items had occurred. This resulted from the fact that items containing 
those tokens, and occurring in both forms, had b«n merged Into a single representation. However, 
some token) had attributes associated with only me possible form, since in some cases no item 
containing that token in its ocher form was integrated into that representation. Consequently, 
subjects In some cases were able to decide that the test item was not identical to the original Form, 
although the relations among tokens matched those in the test item. This produced lower 
acceptance rates For translated items compared to the originals. 

Such a model, although more parsimonious than a dual coding model, does not exclude certain 
forms ftf a dual coding strategy. For instance, suppose subjects encoded each item into its primary 
representational system and stored that form or representation fi.e, propositional wring, 
representing sentences are stored in verbal memory, while imagery representations of pictures are 
stored in pictorial memory). Suppose that some items are also translated into the alternate form 
and the ^presentations for each form are rtored in the appropriate memory, ff the memories for 
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the two kinds Of representations (verbal and pictorial) do not interact during the recognition 
pracen, then tfuriatfm of items which w m not dually encoded are functionally new item* in the 
r^ognitinn twt vthtnas, translations of the dually encoded items are functionally old. The results 
obtained; by Rosenberg and Simon «n now be predicted given the assumption that the difference 
in acceptance between translated and new items presents the number of items dually encoded 
during acquisition. Since this difference was less than ten percent in Rosenberg and Simons study, 
this model results In essentially nnn-kh treacling encoding systems. Thus, although lew elegant, a, 
dual coding model may also explain the partial confusion of subjects berw ren Items which have 
been seen before in the same form, and those which ate translated. 

fn Rosenberg and Simon’s experiments one form, the sentence form, was biased towards a 
verbal encoding, ensuring storage of that form of an Item solely in the verbal memory component 
of a dual coding model. The pictorial form was biased toward* a pictorial encoding, resulting in 
Storage or this form of an item only In the pictorial memory component of the dual coding model. 
Thus the two forms of an Item Were stored in different memories. Dual coding explanations are 
based on that fact. This confound log between the two forms Of a test Item and the TWO encoding 
systems does nut allow ti, to determine whether the result is due to the two functionally 
independent systems of representation (as the dual coding model hypothesises). An alternative 
hypothesis is that It it due to form differences of any sort, whether or not these are divided 
between verbal and pictorial codes. Suppose that stimuli are chosen so that information about 
both forms Of an item is available in one ®de f*|,pictorial). If Subject, still accept some transit 
Items, but fewer translated items than previously seen Items, we will be able CO argue that the result 
in the earlier experiments is explicable without posit,og two infernal representation systems, since 
the information required to accept or reject translations is available within a single representation. 
Such an explanation la desirable since it is more parsimonious chan one based on dual coding. 
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EXPERIMENT] 

One type erf material which ftt* our criterion anc strings derived from from longer letter strings 
<eg- ABCD) These on occur in either upper or lower case, Rrirman and Bower (19'73> have 
shown that Sransford and Franks' results concerning fah? acceptances are replicated when instead 
of being shown sentences, subjects are shown strings of letters or numbers. Tiir fallowing 
experiment used upper and lower case letter strings rather Ihih the sentences and pictures or two 
languages employed by Rosenberg arid Simon. 

Method 

Subieeti The subjects were 4& male and female undergraduates at MIT. All were paid 
volunierrs. 

Materials and Design The following letter strings were used a* the "concepts" ABCD, QRST, 
WXYZ. Each of these cuncepts can be decomposed into four 1 letter strings, six £ letter strings, 
and four 3 letter airings. If she numbs: I is assigned to the first letter in a concept, £ to the second 
letter, and so on, all of the sub-strings can be represented as-- 

One letter 123 4 

Tho latter 23?12 34 14?13 £4 

Three letter 134 124 234 123 

The.experimental design was a modified Latin square. Since there are six 2 letter strings, two 
of these ha^e been randomly grouped with other £ letter strings, to form the above rectangle. Wo 
wish to design our Latin square so that each column and each diagonal contain all the letters in the 
concept. Then J,n order to farm an acquisition list, we need only do the following for each concept. 
First we delete one column, and then we superimpose the following square; 
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U L N 

N U L 

t N U 

Where N means. that this item dors not appear in the acquisition list; U means it appears in upper 
case form; and L means it appears in low*: ease form, Since then: are four possible columns to 
delete, there are fuu: possible acquisition lists which can be formed: one for each column rieleted. 

To form a recognition list, we take one column and present each string in both upper and 
lower case form. Each recognition list then has six strings for each of the three concepts; two 
O lds (items actually two in this Term before); two Translations; and two News (items never 
before s«n 3 but which are exemplars). 

A recognition list formed using a particular column cannot be Used with the acquisition list that 
was formed by deleting that column, Therefore for each acquisition list there arc three possible 
recognition lists. This gives a total of twelve cells In the square. Four subjects were tested in each 
cell. Using these lists, each string appeared once in upper and once in lower case, in the acquisition 
lists. Ip the recognition lists,, each string appeared once in each form as an Old, Translation and 
New item. 

In constructing lists from the three wnceptSj the constraints on the randomisation of order were 
that no more than two strings derived from the same concept could occur in a row: nor could more 
Chan two String! Of the same complexity or case occur together. 

Procedure The experiment twh abotlt ati hour to perform. Subjects were seated in front of a 
tachlltoscope and told they were being tested in a short term memory task. They were thEU 
presented with the Items in art acquisition list Following Reliman and Bowers procedure* each 
item appeared for two seconds, during which Itme it was F«d aloud, Then after a second pause, a 
three digit number appeared fnr Six and a half seconds. Subjects immediately began counting 
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backwards by tbryyy, out feud. and „ quietly » puWbfa. On the dhuppHnney of thy numbyr 
subjects were giver up ro IQ seconds to retail the original string. 

Afier proceeding through the acquisition list in this way„ subjects were shewn one of the 
recognition lilts. They were told that they would be total on Identifying the character string 
ihowr in the acquisition phase, some of which might be new. Each Item in the list wa 4 displayed 
for tip to nitre seconds. During this time subjects were told to m*ke up their minds as quickly as 
pwible whether the string was Identical to one the* had seen previously. They were informed 
that although accuracy was primary, speed of response was also Important. 

Results 

Figure | shows the percentage of acceptances for Old items, Translations, and New strings, 
broken down by complexity. An analysis of variance was performed on the proportions accepted. 
Tht independent variables were type of item (Old. Translate, m New}, and complexity fore, two, 
or three letters in the String). Both the type of recognition: item and the complexity oF the item 
were significant. (F&*3) . 2&.9S; p < J* ahd F&M0 -12.11; p < ,01, respectively,) To make it,re 
that the difference between Old and Translation items was significant; contrasts were done, using 
the Scherre test This produced a signtFlant dirfenence between the OW and Translation string* 

{F(2,24$MSJ* pc.005). Similar^ ilgmlflraniiy more Translations were accepted than New items 
(Ff2,243) - TB7; p < .025), 

Discussion 

The results replicated Rosenberg and Simon's findings. Subjects accepted many translated 
Items as having been presented originally In that form, although not at frequently as Strings shown 
In the original 1 form. In either Case, they accepted more Strings Which had been Shown previously 
it. some form, than never before seen strings. The results also reputed Brantford and Franks' 
finding Chat acceptance; increase as a function of increasing complexity. 
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In the present experisnent the two versions of a string (upper and lower case) are equivalent In 
the readiness with which they can be encoded verbally or picforially. There is no confounding 
beiwrrn the form a String occurs in (upper or lower Ease), and the representation of that form 
hypothesized by dual coding theories (verbal or pictorial), This rules out a dual coding 
explanation that depends to a biased encoding of items by form: for example, a model that claims 
that Items of one me, say lower, ate always represented in one code. say verbal, while the upper 
ea« ris always stored In the pictoiLal aide. In this type of model a Tran station test Item goes first to 
the opposite representation from that of Its original form, With the encoding distinction removed, 
the plausibility of a Translation cannot be determined by comparing the form of a string in the 
pictorial code with its form (or tion'exlitenee) in a verbal code. Thus the use of those two codes as 
a necessary part of the ability to distinguish translations is eliminated when the two forms of items 
art equally pictorial and equally verbal. 

Once the pictorial and verbal confounding in encoding it removed, it has to be the -case that 
form information is preserved within one code, (according to the dual coding model) and not 
between the codes. In a dual coding theory, form information Is presumably preserved m a 
plaorial encoding. The distinction between upper and lower case would not be retained in a 
verbal encoding unless subjects explicitly add a verbal tag (c.g. abc'tawe:). That is unlikely since 
the case of the strings was irrelevant In the task subjects wet? instructed to perform. 

In a dual coding model, if form Information Is fully preserved in one code, we might expect 
subjects to reject Translations* (despite their representation in verbal memory), since the subjects 
can determine that the string is not present in that form in the other code. If form ts not 
preserved (a* when subjects verbally encode without marking the form, and do not store Images of 
any items) then translated Items should be accepted as frequently as previously seen Hems. Neither 
happens. 
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In considering the form a dual cod trig model for iHhe results might take, wc must consider two 
alternative type* of models The fint fort postulate, that subject* cheek fo? (h t presence of a 
« r * n E- bu[ d0 rtet US|? the ^iitence of the original form of an item in pictorial memory as a 
criterion for rejecting' a translation. The most plausible farm of dual coding model, given this 
strategy, is one where subjects first chert verbal memory for an Item, and then chert pictorial 
memory if the item is not found in verbal memory. Since the item wilt never be found in pictorial 
memory If it is a Translation, but may be there if it is an Old Item, this would produce the 
required resulL 

New items provide a baseline for the acceptability of' semantically consistent strings which have 
not hern seen before. Translations of items whkh have been entirely Forgotten should be accepted 
as frequently a? New items, Since neither New nor Translation: Items are found in pictorial 
memory, the greater proportion of Translations accepted OVET New hems represents the proportion 
nf Translations for which a match was found in verbal memory. This results in the prediction 
that only about 12 ot the items were retained Irr verbal memory! This is simply not plausible, 
given the task and the observed percentages of acceptances, (Subjects were instructed not to guess.) 

There is another possible version of a dual ending model, given that subjects are able to- reject 
items If they find the opposite form in pionrial memory. This would allow for acceptances, of 
Translations of items when the verbal code is retained but the pictorial code has been ferrgntten. 
and rejections for Translations of those Hems remembered In pictorial form. This would pr&duce 
rire actual result of many Translation* be 3n g accepted, but fewer Translations than previously seen 
itemi However, the Translations of items which are represented at least in the pictorial code 
should be consistently rejected, The corresponding New Hems may be accepted, since there « no 
alternate form to cause rejection. Thus this model predicts that fewer Translations than New items 
should be accepted. Since subjects in fact: accept significantly more Translations than New items. 
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the dual coding model iannot explain the remits. 

Evidently, some but not lit Form information is rrtitnfd In a useful form. Thu suggests a 
itiodiJ in Which the difference between Old brings and Translations represents the proportion of 
items for Which lurm information allows rejection. The extent to which subjects can reject 
Translation aver Old items will then represent a measure of the degree of useful Form 
information which if retained within a single representation. Since the Olds and Translations are 
identical except far this case Information, it provides the only possible Criterion f 0 j rejecting a 
Translation when the equivalent Old is accepted. This implies that all except this proportion of 
learned strings lose, or cannot us?, the form property as a unique distingulsher. 

The ability of subjects to retain some information about farm OF presentation for words has 
long been known {Hindman, Block. Sc Inaketp. 1972; Kirsner. 1973- Kolers St Olstry, 1974; Light Sr 
Berger, \m- Light, Berger Sc Bardalei, I9T6). Consequently, also finding this eFfect in fetter strings 
which do not form words is not surprising. However, as Light and Berger (197163 point out, this 
result alone does not support an Imagery model over an abstract encoding one. Since the 
recognition process for translation? is a function of the preservation of information within a single 
dual coding models or the present experiment introduce superfluous elements. They are also 
unable to explain the partial confusion of subjects irt a way which is consistent with the 
acceptances of New items 

Rosenberg and Simon have developed a pansmonlous model which uii Kies a single underlying 
representation. This model is equally appropriate for the current experiment, since It does not rely 
on assumptions of encoding bin to produce the observed differences. Thus it provides a 
parsimonious explanation of all three experiments. We should note that Rosenberg and Simon 
were not suggesting that Imagery does not exist Rather, they were proposing that both imagery 
and verbal encodings ate implemented in the same internal system, and differ through their 
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Information content In that system. 

EXPERIMENT jl 

Our argument It dependent an ReJtmin *r>d Bower's original finding that Bransford and 
Franks' results can be replicated using concepts formed from letter and number strings. 
Consequently this experiment replicates theirs, to nuure the basic result lbe first experiment is 
founded an. We expected that the results would replicate theirs, and also replicate the pertinent 
results of the first experiment. The same results for complexity and for Old versus New strings 
should be found in all three experlmcntt 
Method 

Sufai < e5ti The objects were 4S male and female undergraduates of MIT. All were paid 
volunteers. 

Materials and Design Ones again, 4 modified lattn square design was Used, This provides a 
more balanced design than in the original Reitman and Bower method, since each string functions 
“ both an Old and New Item, In this experiment the acquisition and recognition lists were 
formed f rom: the concepts! ABcD, HIJK, WXYZ, md ^567, Each concept contains four I element 
strings (either a letter or a numbed six x element Strings, and four 3 element strings. Two 
acquisition lists were formed by randomly dividing the total set of substrings from each concept 
into two sets of two 1 element strings, three t element strings, and two 3 dement strings. This 
division was subject Co the constraint that each dement appear at least twice in each list, Two 4 

element Strings were then added (0 each acquisition Use w that no i element String w as a H jgrp«l 
twice. 

T wo recognition lists were formed juch that each recognition Itsr contained (For each concept) 
one l element string, either one or two ? element strings, and one 3 clement string from each 
acquisition list. In addition, one f element String from each acquisition list was added to each 
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recognition list, so that no 4 element string appeared twice in a recognition list. The constraints on 
this were that ™ch recognition ILsi contain at least one of each letter or number occuring in richer 
acquisition lilt. The hitie omitnkitt tm ordering the lists hck3 as In the last experiment. 

Each recognition Itlt can be Used with cither acquisition lilt, since half of the Items will have 
appeared in that acquisition lilt and half will have not All four combinations were used, resulting 
Jn each item occuring once as an Old. and once as a New string in the experiment This process 
was repeated three times to give 12 acquisllion-recogmiicm combinations. Four subjects Were run Jn 
each cell. 

Procedure The same procedure was used as in the first experiment, except that (here was only 
a half second pause between presenting an item and presenting the three digit number,. 

Results and Discussion 

An analysis of variance was performed on the percentages of acceptances. The independent 
variables were lie™ complexity, and whether Jt was an Old nr a New string. Figure 2 shows the 
proportions accepted. Both the complexity and type of item were significant {FK.33G) - 2S.S, p < 
-PI; F(I,SSQ} - 27.1. p < ,fl|. respectively.) 

The remits replicated Reltman and Bower's, and also those of the first experiment for 
Complexity. As strings increased in Complexity, subjects were more likely to accept them. However, 
as Reltman and Bower, Franks and Brartsfond, and Rosenberg and Simon Found, fewer New Irems 
were accepted than Old, 

Rcitman and Bower suggested that either subjects Store the concept together With rules for its 
generation, or else they store the concept together with many of the strings. It is unlikely subjects 
adapt the first alternative in these experiments, since In that case there is no way to distinguish 
among Olds and Translations. Therefore they must store some strings, or at least some attributes 
Of Items. Rosenberg and Simon's model suggests that they might integrate strings derived from the 
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lame concept Of course, in this q» subjects should be unable to distinguish the form of an item 
by matching against this stored concept. However, IS Reitman and Bower point out, Brantford 
and! Franks' design overloads subjects by presenting multiple items from several concepts. They 
argue that the Brantford and Franks materials and procedures may have arranged conditions in 
such a manner ai to cause massive forgetting oF the particular exemplars, h This suggests that 
subjects may form not one, but several partial mergings of strings, forming more or less whole 
instances of the concept. Depending upon which of these a recognition item is matched against, 
the following might occur. Bath the original arrd the translated form (if it is given}, will he 
subject to a component of forgetting which depends on hD-w well subjects hive succeeded in 
merging strings to form the concept, and on the rules for matching against this concept. However, 
the translated form, if given, will be subject to a component of rejection due to the fact that the 
letter tokens may not all have the neccessary attributes for that form in these partially merged 
concept instances. ThJ* will produce somewhat lower levels Of acceptances for these items. This 
would result in the current finding that in some but not all case; subjects Cannot distinguish the 
form of the input 

The two present experiments argue for a model tn Which information about the form of an 
item Is preserved in a Single memory system in which related items expressed In different forms 
are merged into one representation. This view parsimoniously explains both the current 
experiments and Rosenberg and Simon's study. Dual coding models fail to explain the current 
results. In addition, they require different formulations for the current experiment than for 
P.csenberg and Simon's, although the results of bot h are the same. 
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Figure Caption* 


Figure I, Percent of Old, Translate and New exemplars attept«£ tn Experiment L 


Fi^Jre 2, Percent or Old and New items accepted in Experiment % 
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